simpolycat: an SAS program for conducting CAT simulation based on polytomous IRT models.
نویسندگان
چکیده
A real-data simulation of computerized adaptive testing (CAT) is an important step in real-life CAT applications. Such a simulation allows CAT developers to evaluate important features of the CAT system, such as item selection and stopping rules, before live testing. SIMPOLYCAT, an SAS macro program, was created by the authors to conduct real-data CAT simulations based on polytomous item response theory (IRT) models. In SIMPOLYCAT, item responses can be input from an external file or generated internally on the basis of item parameters provided by users. The program allows users to choose among methods of setting initial , approaches to item selection, trait estimators, CAT stopping criteria, polytomous IRT models, and other CAT parameters. In addition, CAT simulation results can be saved easily and used for further study. The purpose of this article is to introduce SIMPOLYCAT, briefly describe the program algorithm and parameters, and provide examples of CAT simulations, using generated and real data. Visual comparisons of the results obtained from the CAT simulations are presented.
منابع مشابه
The Relationship between Parameters from Two Polytomous Item Response Theory Models
RESPONSE THEORY MODELS Various polytomous IRT models parameterize the probability of response categories differently from each other. For example, the graded response model (GRM) (Samejima, 1969) is based on the cumulative log-odds principle, whereas the generalized partial credit model (GPCM) (Muraki, 1992) is based on the adjacent log-odds principle. It is widely known that these two polytomo...
متن کاملA Model for Student Knowledge Diagnosis Through Adaptive Testing
This work presents a model for student knowledge diagnosis that can be used in ITSs for student model update. The diagnosis is accomplished through Computerized Adaptive Testing (CAT). CATs are assessment tools with theoretical background. They use an underlying psychometric theory, the Item Response Theory (IRT), for question selection, student knowledge estimation and test finalization. In pr...
متن کاملA Comparison of Item and Testlet Selection Procedures
Testlet response theory (TRT) is a measurement model that can capture local dependency in testlet-based tests. One of the purported advantages of TRT over the more commonly-used polytomous IRT approach to modeling testlet-based tests is that it allows for ad hoc testlet construction in a testlet-based computer adaptive test (CAT). The goal of this study was to investigate the merits of such a C...
متن کاملAssessing IRT Model-Data Fit for Mixed Format Tests
This study examined various model combinations and calibration procedures for mixed format tests under different item response theory (IRT) models and calibration methods. Using real data sets that consist of both dichotomous and polytomous items, nine possibly applicable IRT model mixtures and two calibration procedures were compared based on traditional and alternative goodnessof-fit statisti...
متن کاملIRT-FIT: SAS® Macros for Fitting Item Response Theory (IRT) Models
Psychometrics has recently seen the development of complex measurement models to better represent test and item data. Item Response Theory (IRT), in particular, comprises a set of non-linear latent variable models that appear to have several conceptual and empirical properties that make them more valuable in practice than classical test theory methods. However, IRT-based models typically requir...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید
ثبت ناماگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید
ورودعنوان ژورنال:
- Behavior research methods
دوره 41 2 شماره
صفحات -
تاریخ انتشار 2009